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DIFFERENTIAL  PERFORMANCE  OF  FLEET  AND  RECRUIT 


PERSONNEL  IN  TCKFEDOMAN'S  MATES  SCHOOL 


Abstract 


The  purpose  of  this  study  was  to  evaluate  the  influence  that  certain 
background  and  training  factors  may  have  upon  the  relationships  between 
test  scores  and  criterion  measures . Enlisted  personnel  who  enter  Navy 
training  schools  cane  either  from  the  fleet  or  directly  from  recruit  train- 
ing schools.  Whether  the  fleet  personnel  perform  better  or  poorer,  in 
relation  to  ability,  than  do  the  personnel  who  come  from  recruit  training 
centers  is  a question  of  considerable  importance  for  selection  procedures. 

The  results  of  the  study  indicate  that  the  fleet  subjects  earned 
higher  grades  in  a Torpedoman f s Mates  School  than  did  recruit  subjects  who 
had  similar  scores  on  tests  from  the  Navy  Basic  Battery.  Although  the 
factors  of  age  and  education  were  significantly  correlated  with  school 
grades,  these  factors  did  not  appear  to  account  for  the  superior  performance 
of  the  fleet  subjects. 

Another  factor  that-  may  have  operated  in  favor  of  the  fleet  subjects 
was  their  past  experience  with  mechanical-motor  activities.  The  influence 
of  this  factor  was  examined  in  two  ways . When  defined  on  the  basis  of 
scores  obtained  from  a check  list  of  mechanical -mot  or  tasks,  such  indices 
of  previous  experience  failed  to  correlate  significantly  with  either  school 
grades  or  predictor  variables.  However,  analysis  did  disclose  a tendency 
for  the  fleet  subjects  to  earn  higher  scores  than  did  recruits  on  a learn- 
ing task  involving  the  assembly  of  a breech  block  mechanism,  when  scores 
from  the  Navy  Basic  Battery  were  taken  into  consideration.  When  an  attempt 
was  made  to  partial  out  the  influence  of  previous  mechanical-motor  experi- 
ence by  taking  into  account  the  scores  on  the  learning  task,  course  grades 
for  fleet  subjects  Btill  tended  to  be  higher  than  those  for  recruits.  The 
findings  thus  suggested  that  there  were  additional  factors  accounting  for 
the  better  school  performance  of  the  fleet  subjects.  Several  hypothes.es 
regarding  the  nature  of  these  factors  were  formulated. 
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ii 

Since  the  study  led  to  the  conclusion  that  the  two  groups  had. 
performed  significantly  differently  in  school  with  ability  taken  into 
account,  separate  selection  procc-aures  are  recommended  for  the  nwo  groups. 
Further  research  is  suggested  ro  determine  whether  aimlar  differences 
prerail  in  other  Nary  training  schools.  If  so,  ri-eavch  studies  ttireec  »t 
the  identification  of  the  factors  related  to  the  better  performance  of 
the  fleet  personnel  might  he  initiated . 
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DIFFERENTIAL  PERFORMANCE  OF  FLEET  AND  RECRUIT 


PERSONNEL  IN  TORPEDOMAN’S  MATES  SCHOOL 


Introduction 


Frequently  candidates  for  industrial  jobs  or  schools  are  drawn 
from  several  different  sources.  An  important  problem  that  arises  is 
whether  a different  selection  procedure  should  be  used  for  candidates 
from  each  source,  or  whether  the  characteristics  of  these  groups  of 
individuals  are  sufficiently  similar  to  make  a single  selection  pro- 
cedure appropriate.  In  the  Navy,  this  type  of  problem  occurs  when  stu- 
dents for  training  schools  are  selected  either  from  the  fleet  or  from 
recruit  training  centers,  with  such  selectees  obviously  differing  with 
respect  to  their  experience  in  the  Navy.  For  saqe  Navy  schools,  to  be 
selected  from  recruit  training  c^-uers  a recruit  must  have  test  scores 
at  or  above  established  critical  scores,  whereas  for  students  from  the 
fleet  this  requirement  may  be  waived  in  some  instances. 

This  project  was  undertaken  in  order  to  evaluate  the  influence 
which  such  background  and  training  factors  might  have  upon  the  relation- 
ships between  test  scores  and  criterion  measures.  The  results  of  such 
a study  were  expected  to  be  of  value  in  indicating  circumstances  under 
which  the  predictiveness  of  test  scores  might  be  markedly  affected,  and 
thus  to  be  of  aid  in  the  further  development  of  Navy  selection  and  clas- 
sification procedures. 

The  relationship  between  school  grades  and  scores  on  a selection 
test  in  a situation  where  a cutting  score  on  a selection  test  is  employed 
for  a portion  of  the  students  is  schematically  represented  in  Figure  1. 

The  conventional  procedure  for  developing  an  equation  for  predict- 
ing course  grades  from  test  scores  is  equivalent  to  determining  the 
average  course  grade  made  by  the  group  of  individuals  who  have  scores 
in  each  of  several  score  intervals  on  the  selection  test.  By  plotting 
these  pairs  of  numbers  as  points  and  drawing  a straight  line  through 
them,  one  would  obtain  a regression  line  for  each  group  of  individuals 
similar  to  the  lines  shown  in  Figure  1. 
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Figure  1.  A hypothetical  illustration  of  the  relationship  between  measures 
of  success  in  a Navy  school  and  scores  on  a selection  test.  The 
. figure  represents  the  situation  where  a minimum  score  hab  been 
established  for  one  group  of  subjects,  say  the  recruit  subjects. 
Since  the  regression  of  success  on  selection  test  scores  is  not 
influenced  by  this  cutting  score,  the  regression  lines  of  the  two 
groups  may  be  compared.  In  this  hypothetical  case,  the  slopes 
and  vertical  intercepts  are  sufficiently  different  to  warrant 
separate  prediction  equations  for  the  two  groups.  Had  the  re- 
gression lines  coincided,  a single  prediction  equation  would 
suffice . 
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When  a regression  line  is  constructed  in  this  manner,  jt  should 
he  noted  that  the  slope  of  the  line  and  the  point  at  which  it  intersects 
the  vertical  axis  should  he  the  same  whether  it  is  based  upon  the  scores 
to  the  left  of  the  critical  score,  those  to  the  right,  or  for  all  scores 
on  the  selection  test.  If  the  subjects  from  the  fleet  and  recruit  train- 
ing centers  earn  about  the  same  course  grades  relative  to  their  scores 
on  the  selection  test,  the  regression  lines  should  coincide.  If  one 
group  of  subjects  earn  higher  grades  relative  to  their  ability  on  the 
selection  test  than  do  the  other,  then  the  regression  lines  for  the  two 
groups  may  have  different  slopes  and  different  intercepts  with  the  vert- 
ical axis.  In  that  event,  separate  selection  procedures  would  seem  ad- 
visable . 

We  have  just  given  an  intuitive,  non-rigorous  statement  of  the 
problem  confronted  in  this  study,  namely,  to  determine  whether  the  re- 
gression of  Navy  grades  on  selection  test  scores  is  the  same' for  fleet 
* subjects  as  for  recruit  subjects. 

Procedure 

The  data  upon  which  this  study  was  based  were  secured  in  connec- 
tion with  another  study  (l)  in  which  learning  measures  were  developed 
as  a possible  predictor  of  success  in  a Torpedoman's  Mates  School.  The 
study  was  conducted  during  the  last  six  months  of  1952  at  a Class  "A" 
Torpedoman's  Mates  School.  The  sixteen-week  program  in  this  school  pro- 
vided training  on  the  checking,  maintaining,  testing,  repairing,  and 
overhauling  of  underwater  ordnance  used  on  naval  vessels  and  aircraft, 
including  torpedoes,  depth  bombs,  depth  charges,  and  ordnance  detectors. 

Two  hundred  and  seventy-six  students  from  six  consecutive  classes 
at  the  school  participated  in  the  study.  Ninety-five  of  these  students 
, had  been  selected  from  the  fleet,  whereas  the  remaining  one  hundred 

and  eighty-one  had  been  selected  from  recruit  training  centers.  These 
two  groups  will  be  designated  fleet  and  recruit,  respectively. 

f The  principal  factor  in  the  selection  of  students  for  the  Torpedo- 

f man's  Mates  School  was  performance  on  the  Mechanical  Aptitude  Test,  a 

score  of  55  or  better  being  required  for  selection;  this  score  is  ex- 
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ceeded  by  approximately  31$  of  all  Naval  enlisted  personnel.  Less  than 
two  per  cent  of  the  roe'-uit  subjects  in  the  study  were  found  to  have 
scores  below  this  point.  However,  in  the  case  of  fleet  personnel  (for 
whom  this  requirement  was  often  waived  for  various  reasons),  approxi- 
mately one-half  of  the  subjects  in  the  study  were  found  to  have  scores 
below  the  cutoff  point. 

A more  recent  basis  for  selection  is  a minimum  combined  score 
of  105  on  the  Arithmetic  Test  and  Mechanical  Aptitude  Test.  However, 
about  one -half  of  the  subjects,  both  recruit  and  fleet,  had  combined 
scores  below  this  cutoff  poinx.  For  this  reason,  it  will  be  assumed 
that  the  Mechanical.  Aptitude  Teat  was  the  essential  basis  for  selection. 

The  predictor  variables.  Scores  on  tests  in  the  Navy’s  Basic  Battery 
were  already  available  in  the  records  of  the  subjects,  the  testing 
having  occurred  prior  to  selection.  Brief  descriptions  of  these  tests 
follow: 

1.  General  Classification  Test.  This  is  a test  of  verbal  ability 

based  upon  three  types  of  items:  Sentence  Completion,  Opposites,  and 

Analogies . 

2.  Arithmetic  Test.  Items  in  this  test  are  of  two  types:  (a) 

problems  involving  routine  computation,  and  (b)  verbally  stated  problems 
measuring  ability  to  think  in  quantitative  terms. 

3*  Mechanical  Aptitude  Test.  This  test  consists  of  two  parts: 

(a)  mechanical  and  electrical  knowledge,  and  (b)  mechanical  comprehen- 
sion. The  latter  involves  the  ability  to  perceive  visually  the  mechan- 
ical details  of  a problem  situation,  and  to  apply  various  physical  prin- 
ciples to  arrive  at  a solution. 

4.  Clerics!  Aptitude  Test.  This  is  a speeded  test  requiring 
name  checking  and  number  checking. 

The  above  four  tests  are  standardized  Navy  tests  whose  scores 
have  a mean  of  50  and  a standard  deviation  of  10  in  a population  of  all 
Naval  enlisted  personnel.  The  following  additional  test  was  employed : 

5.  Block  Counting  Test.  Since  it  is  possible  that  the  Basic 
Battery  may  later  include  a spatial  test,  the  Classification  and  Survey 


-5- 


[ 

I 

I; 

I ,i 


! 


i 


I 


i 

i 

f 

i 

i 

t 


M 


* 


i 


I 

! 

! 


Branch,  Personnel  Analysis  Division,  Bureau  of  Naval  Personnel,  requested 
that  two  tests  of  spatial  ability  be  administered  at  the  same  time  as  the 
experimental  tests  described  below.  One  of  the  spatial  tests  was  a con- 
ventional block,  counting  test. 

The  second  spatial  test  was  a surface  development  or  pattern  ar- 
rangement test  in  which  the  subject  was  required  to  transform  viBually 
a two-dimensional  projection  to  three  dimensions  as  shown  in  perspective. 
During  the  experimental  testing  it  became  apparent  that  the  directions 
for  this  latter  test  were  not  adequate  and,  therefore,  data  for  this 
tost  are  not  included  in  the  analysis  reported  below. 

The  experimental  variables.  In  addition  to  the  spatial  tests  described 
above,  several  experimental  tests  were  administered  to  the  subjects 
during  their  first  week  of  instruction  at  the  Torpedoman’s  JfeteB  School. 

Two  of  these  tests  are  relevant  to  this  report. 

1.  Breech  Block  Performance  Teat.  The  primary  aim  of  the  companion 
study  (l)  was  to  develop  measures  of  learning  ability  that  would  predict 
future  performance  in  schools  teaching  mechanical-motor  skills,  and  to 
determine  whether  such  measures  would  increase  the  predictive  efficiency 
of  currently-used  selection  instruments.  That  study  is  described  in 
detail  in  reference  1.  The  experimental  design  of  the  learning  study 
was  to  create  a miniature  training  situation  and  to  follow  that  by  a 
testing  session.  Since  the  Torpedoman’s  Mates  School  was  primarily 
concerned  with  the  development  of  mechanical-motor  skills,  such  as 
assembly-type  operations,  performance  testing  appeared  to  be  an  appro- 
priate medium  for  the  measurement  of  learning. 

A sound  film  describing  the  step-by-step  assembly  of  the  breech 
block  of  a mm.  antiaircraft  gun  constituted  the  training  material. 

The  original  film  from  which  this  film  was  taken  had  been  developed 
for  Special  Devices  Center  of  CNR  by  Pennsylvania  State  College.  The 
training  film  (approximately  two  minutes)  was  presented  to  the  subjects 
who  were  then  given  three  minutes  to  assemble  as  much  of  the  breech 
block  as  possible.  Following  the  first  trial  the  subjects  again  were 
shown  the  film.  Subsequently,  they  were  given  another  three -minute 
period  on  the  actual  assembly  task.  This  procedure  was  repeated  for 
a total  of  five  cycles.  Each  time,  a proctor  rated  each  subject’s 
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performance,  using  a specially  prepared  objective  record  sheet.  For 
each  assembly  trial,  the  subject  was  given  separate  scores  for  the 
number  of  steps  completed  correctly  and  the  amount  of  time  consumed, 
lhe  learning  score  reported  in  the  present  analysis  was  the  cumulative 
rate  of  work  for  the  five  trials.  Other  learning  measures  and  their 
relationships  with  the  other  variables  are  discussed  in  the  report  of 
the  companion  study. 

2.  Experience  Check  List.  The  possibility  that  previous  experi- 
ence in  mechanical -motor  activities  might  be  a concomitant  of  perform- 
ance on  the  learning  task  led  to  the  development  of  an  experience  check 
list  of  142  items.  The  following  are  examples  of  the  type  of  questions 
included:  Have  you  driven  a tractor?  operated  a power  hammer?  changed 

a tire  on  a car?  fixed  a leaky  water  tap?  shingled  a roof?  done  any 
kind  of  riveting?  operated  sound  recording  equipment?  installed  or 
repaired  telephones?  assembled  or  disassembled  a watch  or  clock?  and 
so  on.  For  each  item  the  subject  indicated  whether  he  had  had  no  ex- 
perience, had  performed  the  task  but  did  not  believe  he  was  skilled, 
or  had  performed  the  task  sufficiently  to  have  acquired  a considerable 
degree  of  skill.  The  scores  on  the  Experience  Check  List  were  simply 
the  number  of  responses  in  each  of  the  three  categories , designated 
throughout  this  report  as  ECL-A,  ECL-B,  and  ECL-C,  respectively. 

More  than  half  of  these  items  -came  from  an  Experience  Record 
developed  for  a different  purpose  by  Professor  Robert  L.  Thorndike  of 
Teachers  College,  Columbia  University,  under  an  USAF  contract.  The  re- 
mainder of  the  items  were  developed  by  the  present  writer. 

The  criterion  variables . Two  criteria  of  success  in  the  Torpedoman's 
Mates  School  were  obtained. 

1.  Average  grade  on  weekly  performance  tests.  This  score  was 
the  average  score  on  nine  or  more  of  the  eleven  weekly  performance 
tests  administered  during  the  training  course.  These  performance  tests 
were  based  upon  such  topics  as  main  engines,  gyros,  basic  electricity, 
Mark  27  torpedo,  and  so  on. 

2.  Final  grade  in  course.  This  grade  was  a composite  of  the 
average  weekly  grade  (6d$),  the  grade  earned  on  the  final  written 
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test  (2056),  and,  the  grade  earned  on  the  final  identification  teat  (20$) . 

The  average  weekly  grade  was  obtained  by  weighting  the  average  grade  on 
the  weekly  performance  teats  60$,  the  average  grade  on  weekly  written 
testa  20$,  and  the  average  grade  on  weekly  identification  tests  20$. 

These  percentage  weights  do  not  take  into  consideration  the  intercorre- 
lations or  the  variabilities  of  the  measures  Involved , and  thus  do  not 
necessarily  represent  the  effective  weights  of  these  variables. 

ALL  of  the  above  criterion  tests  were  objective-type  tests  constructed 
by  staff  members  of  the  Torpedoman *8  Mates  School.  To  maintain  test  secur- 
ity, some  of  the  tests  had  to  be  modified  from  time  to  time.  The  Torpedo- 
man’s Mates  School  lacked  the  necessary  facilities  to  insure  that  the 
various  forms  of  any  test  were  parallel,  which,  meant  that  the  criteria 
have  an  unknown  amount  of  variability  from  class  to  class.  It  would  have 
been  preferable  for  research  purposes,  and  perhaps  for  the  purposes  of 
the  Torpedxnan’s  Mates  School  itself,  to  have  available  final  performance 
and  achievement  tests  which  have  been  standardized  and  which  have  alternate 
parallel  forms.  This  would  permit  a certain  amount  of  stability  in  the 
criteria  when  successive  classes  sire  to  be  compared  or  combined. 


Results  and  Discussion 


In  order  to  facilitate  presentation  of  the  results  and  appropriate 
discussion,  this  section  is  divided  into  three  parts:  (l)  the  relation- 

ship between  the  criteria  and  selected  predictor  variables;  (2)  the  in- 
fluenee  of  age,  education,  previous  mechanical  experience,  and  learning 
ability  on  the  relations  between  tests  and  criterion  measures;  su’d.  (3) 
the  factors  hypothesised  to  account  fur  better  performance  of  fleet 
personnel.  The  nucleus  for  these  parts  is  Table  1,  which  contains  the 
intercorrelations  of  the  predictor,  experimental,  and  criterion  variables, 
together  with  their  means,  standard  deviations,  and  standard  errors  of 
estimate . 

Relationship  between  the  criteria  and  selected  predictor  variables.  The 
means  and  standard  deviations  for  the  recruit  subjects  and  the  fleet 
subjects  were  approximately  the  same  on  the  General  Classification  Test, 
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Arithmetical  Reasoning  Test,  Clerical  Aptitude  Test,  and  the  spatial 
test.  It  should  he  recalled,  in  connection  with  Figure  1,  that  the  re- 
cruit subjects  were  selected  from  individuals  whose  Mechanical  Aptitude 
Test  scores  were  above  55  while  the  fleet  subjects  had  Mechanical  Apti- 
tude Test  scores  extending  below  this  critical  point.  Thus,  the  find- 
ing that  the  recruit  subjects  had  a higher  mean  and  a smaller  standard 
deviation  on  this  test  was  anticipated. 

The  learning  scores  derived  from  the  Breech  Block  Performance  Test 
had  about  equal  means  and  standard  deviations  for  the  two  groups.  One 
implication  of  this  finding  is  that  the  two  groups  had  approximately 
the  same  performance  on  a task  similar  to  their  training  program, 
despite  differences  in  their  backgrounds.  This  will  be  discussed  fcgfcin 
later. 

Both  final  grades  and  the  average  grades  on  weekly  performance 
tests  had  higher  means  and  smaller  standard  deviations  for  the  fleet 
subjects  than  for  the  recruit  subjects.  From  such  findings  one  might 
conclude  that  the  fleet  subjects  had  achieved  more  in  school  than  the 
recruit  subjects.  On  the  other  hand,  the  better  performance  of  the 
fleet  subjects  may  have  reflected  differences  in  abilities  between  the 
two  groups  which  existed  before  entering  the  school.  Die  important  ques 
tion  to  ask  is  whether,  in  general,  fleet  and  recruit  subjects  having 
similar  scores  on  prediction  tests  perform  similarly  or  differently 
with  respect  to  school  grades.  To  answer  this  question  an  analysis  of 
covariance  method  developed  by  Gulliksen  and  Wilks  (5)  was  employed, 
using  a computational  procedure  developed  by  Dr.  Ledyard  R Tucker.* 

With  this  covariance  method  it  is  possible  to  test  three  hypothe- 
ses: H^:  that  the  standard  errors  of  estimating  the  criterion  from  a 

specified  predictor(s)  are  equal  for  fleet  subjects  and  recruit  subjects 
Eg:  that  the  slopes  of  the  regression  lines  or  planes  (regression  of 

criterion  on  predictor(s ) ) are  the  same  for  the  two  groups;  and  K^: 


Dr.  Tucker's  procedure  is  presented  in  the  appendix  of  Frederiksen,  N., 
and  Schrader,  W.  B.,  Adjustment  to  College.  Princeton,  New  Jersey: 
Educational  Testing  Service,  1951* 
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that  the  criterion  intercepts  of  the  regression  lines  or  planes  are  the 
same  for  the  two  groups.  Eg  assumed  that  E^  was  supported;  , in 
turn,  assumed  that  Eg  was  supported.  If  was  not  rejected,  then 

it  is  legitimate  to  consider  that  the  same  prediction  formula  could  be 
used  with  both  groups.  If  Hc  was  rejected  (and  and  Eg  supported) 

then  the  two  groups  differ  by  a constant  amount  which  would  be  incorporated 
in  the  prediction  formulas.  If  either  or  Hg  is  rejected,  then 

separate  prediction  formulas  are  also  warranted. 

Several  analyses  of  covariance  were  made  in  which  final  grades  or 
weekly  performance  average  grades  were  set  as  the  criterion  and  the  regres- 
sions of  the  criterion  on  various  combinations  of  predictor  variables  were 
studied.  The  probability  that  the  differences  obtained  between  the  re- 
cruit subjects  and  fleet  subjects  may  have  occurred  as  chance  deviations 
from  a true  difference  of  zero  was  determined  for  each  of  the  three 
hypotheses  tested.  In  addition  to  the  levels  of  significance  of  the  dif- 
ferences, the  magnitudes  of  the  differences  were  also  determined  for  the 
cases  in  which  HA  and  Eg  were  accepted.  These  magnitudes,  which  repre- 
sent the  distance  between  the  criterion  intercepts,  were  expressed  in 
terms  of  pooled  star.dard-error-of -estimate  units  and  transformed  into 
an  estimate  of  the  percentage  of  fleet  subjects  excelling  the  average  re- 
cruit subject.  The  percentage  thus  estimates  the  advantage  the  fleet 
subjects  had  over  the  recruit  subjects,  for  example,  after  differences 
in  predictor  scores  have  been  taken  into  consideration.  Table  2 summar- 
izes these  findings. 


From  Table  2 it  becomes  rather  apparent  that  the  regressions  of 
both  of  the  criteria  upon  various  predictor  variables  resulted  in  all 
cases  in  either  a significant  difference  in  the  slopes  ( Hg  ) or  in  the 
criterion  intercepts  ( Hp  ) of  the  regression  planes  of  the  fleet  sub- 

v 

jects  and  the  recruit  subjects.  It  is  also  apparent  that  the  fleet  sub- 
jects had  a definite  advantage  over  the  recruit  subjects — in  general, 
about  70  per  cent  of  the  fleet  subjects  exceeded  the  average  recruit 
subject  in  terms  of  grades  earned  in  the  school,  (if  there  were  no  dif- 
ference, 50  per  cent  of  the  fleet  subjects  would,  of  course,  exceed  the 
average  recruit  subject. ) The  analysis  failed  to  demonstrate  a signifi- 
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cant  difference  between  the  standard  errors  of  estimating  the  criterion 
from  the  predictor(s).* 

The  interpretation  of  Tables  1 and  2 may  perhaps  be  clarified  by 
examining  the  prediction  of  final  grades  on  the  basis  of  Mechanical  Apti- 
tude scores.  The  standard  error  of  predicting  final  grades  from  Mechan- 
ical Aptitude  scores  and  the  slopes  of  the  regression  lines  were  about 
the  same  for  the  two  groups.  However,  the  criterion  intercepts  of  the 
regression  lines  were  significantly  different.  The  regression  lines  for 
the  two  groups  are  shown  in  Figure  2. 

Figure  £ represents  the  results  reported  in  Tables  1 and  2 for 
Final  Grades  and  Mechanical  Aptitude  Test  scores.  We  have  noted  that 
the  scores  for  the  recruit  subjects  on  the  Mechanical  Aptitude  Test  had 
a higher  mean  and  a smaller  standard  deviation  than  the  scoreB  for  the 
fleet  subjects,  whereas  the  final  grades  for  the  fleet  subjects  had  a 


* 

A word  should  be  interjected  at  this  point  concerning  one  of  the  P- 
values  reported  in  Table  2.  Investigating  for  the  regression  of 

final  grades  on  GCT,  ARI,  MA,  CA,  and  Spa  resulted  in  a P- value  approach- 
ing unity,  a P- value  which  suggested  that  the  standard  errors  of  esti- 
mate of  the  two  groups  were  more  alike  that  would  normally  be  attribu- 
tabls  to  chance  fluctuations.  In  order  to  obtain  a solution  it  became 
necessary  to  cany  out  the  computations  to  a greater  number  of  places 
than  usual,  resulting  in  .99  > P > .98*  It  should  be  mentioned  that 
one  source  of  equating  the  errors  of  estimate  might  have  been  an  error 
in  computation  or  tabulating  operations;  an  independent  check  was  made 
of  these  operations  and  no  error  was  uncovered.  Another  method  which 
might  have  equated  the  standard  errors  of  estimate  for  the  two  groups 
would  be  to  scale  the  criterion  separately  for  the  two  groups  by  means 
of  the  predictor  variables,  thus  setting  their  standard  errors  of  esti- 
mate equal;  this  definitely  was  not  the  case.  Since  the  regression 
weights  of  the  predictors  were  different  for  the  two  groups,  the  only 
explanation  that  seems  plausible  is  than  this  was  the  one  time  in  a 
large  number  of  trials  that  the  two  groups  would  give  chance  differ- 
ences this  small.  (Credit  is  due  to  Dr.  Ledyard  R Tucker  and  Miss 
Henrietta  Gallagher  for  several  suggestions  and  discussions  about  this 
rare  occurrence . ) 
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Figure  2. 


The  relationship  between  final  grades  earned  in  Torpedoman’s  Mates 
School  and  scores  on  the  Navy  Mechanical  Aptitude  Test.  The 
elliptical  contours  show  that  although  the  recruit  subjects  had  a 
higher  mean  score  and  smaller  variability  on  the  Mechanical  Aptitude 
Test  than  did  the  fleet  subjects,  the  fleet  subjects  earned  a higher 
mean  grade  in  school  than  did  the  recruit  subjects.  The  contours 
also  illustrate  the  fact  that  the  regression  lines  were  approxi- 
mately parallel  for  the  two  groups  and  separated  by  a distance  equal 
to  .63  of  a pooled- standard-error-of -estimate  unit.  (The  ellipses 
were  obtained  from  the  general  standard  score  formula 
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higher  mean  and  a smaller  standard  deviation  than  did  grades  for  the 
recruit  subjects.  It  was  also  found  that  the  standard  errors  of  esti- 
mating final  grades  from  scores  on  the  Mechanical  Aptitude  test,  and 
the  slopes  of  the  appropriate  regression  lines,  were  not  significantly 
different  for  the  two  groups.  However,  the  recruit  and  fleet  regression 
lines  intersected  the  grade  axis  at  different  points. 

What  all  this  means  is  essentially  this:  If  prediction  of  final 

grades  were  based  upon  Mechanical  Altitude  test  scores  only,  then  for  a 
given  score  on  the  Mechanical  Aptitude  test  two  predicted  grades  might 
be  considered,  corresponding  to  the  two  regression  lines  indicated  in 
Figure  2.  If  the  subject  under  consideration  came  from  a recruit  train- 
ing center,  we  would  estimate  his  most  likely  final  grade  as  the  lower  of 
the  two  possible  grries.  On  the  other  hand,  for  a fleet  subject  we  would 
use  the  upper  regression  line  to  obtain  an  estimate  of  his  most  likely 
school  grade.  We  might  note  that  were  all  predictions  to  be  based  upon 
the  regression  line  for  the  fleet  subjects,  the  recruits  would  tend  to 
earn  grades  in  school  below  their  predicted  grade,  and  hence  would  be 
classified  as  "underachievers,  *'  whereas  the  converse  would  occur  if  we 
employed  only  the  regression  line  for  the  recruit  subjects. 

To  summarize  thus  far,  the  results  indicated  that  fleet  subjects 
earned  higher  grades,  both  final  grades  and  weekly  performance  grades, 
in  a Torpedoman's  Mates  School  than  did  recruit  subjects  of  similar 
ability  as  measured  by  tests  from  the  Navy  Basic  Battery.  A parallel 
result  was  obtained  when  the  subjects  were  controlled  on  learning 
ability  based  upon  the  Breech  Block  Performance  Test.  These  findings 
strongly  favor  separate  selection  procedures  for  the  two  groups;  if  a 
cutting  score  is  to  be  used,  different  critical  scores  should  be  used 
for  the  two  groups.  Hie  findings  also  suggest  that  there  are  factors 
associated  with  fleet  duty  which  lead  to  better  performance  in  this 
training  school. 

He  influence  of  age,  education,  previous  mechanical  experience,  and 
learning  ability  on  the  relations  between  test  and  criterion  measures. 

Age  and  education  were  two  factors  which  might  be  associated  with  the 
better  performance  of  the  fleet  subjects.  Analysis  of  these  factors 
showed  that  both  variables  had  low  but  significant  correlations  with 
final  grades  and  weekly  performance  grades.  (These  correlations  are 
reported  in  Table  1 . ) 


i 

-15- 

From  Table  1 it  will  be  observed  that  the  fleet  subjects  were  some- 
what older  and  their  ages  spread  over  a longer  span  than  the  recruits. 

With  respect  to  education  the  two  groups  were  about  the  same.  The  means 
and  standard  deviations  of  grades  and  also  the  correlations  with  school 
performance  were  essentially  alike  for  the  two  groups. 

Age  and  education  were  combined  with  the  Mechanical  Aptitude  Test 
and  the  multiple  regressions  of  the  criteria  on  these  variables  were 
analyzed  by  the  covariance  method  discussed  earlier.  The  results  are 
reported  in  Table  3 and  indicate  that  the  fleet  subjects  earned  higher 
grades  than  recruit  subjects  of  similar  ability  and  background  on  these 
variables.  The  essential  difference  between  the  regression  planes  lies 
in  their  criterion  intercepts — the  distance  between  intercepts  was  .36 
of  a standard-error-of -estimate  unit.  This  distance  indicates  that 
approximately  6k  per  cent  of  the  fleet  subjects  earned  higher  grades 
than  the  average  recruit  earned. 

Another  factor  to  be  considered  was  previous  experience  in  mechan- 
ical-motor operations.  The  three  scores  (ECL-A,  ECL-B,  and  ECL-C)  from 
the  Experience  Check  List  were  used  as  one  basis  for  evaluating  past 
experience  in  the  mechanical -motor  area.  Surprisingly  enough,  the 
means  and  standard  deviations  of  the  three  categories  (see  Table  l) 
were  approximately  the  same  for  the  fleet  and  recruit  subjects.  More- 
over, the  zero-order  correlations  between  these  scores  and  grades 
earned  in  the  school  were  not  significantly  greater  than  zero.  As 
defined  by  this  Instrument,  previous  mechanical -motor  experience  was 
not  a factor  relevant  to  success  in  the  Torpedoman's  Mates  School. 

However,  the  ECL-A  scores  did  have  significant  negative  correla- 
tions with  the  learning  scores  from  the  Breech  Block  Performance  Test 
and  indicates  that  fleet  or  recruit  personnel  who  had  had  limited  ex- 
perience in  a variety  of  mechanical-motor  tasks  tended  to  earn  low 
scores  on  the  learning  task.  Fcr  the  fleet  subjects,  there  was  also 
a significant  correlation  between  the  ECL-A  and  ECL-C  scores  and  scores 
on  the  Mechanical  Aptitude  Test. 

The  learning  measures  permitted  a further  analysis  of  possible 
transfer  effects  which  might  have  favored  the  fleet  subjects.  The  re- 
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gressions  of  the  learning  scores  (from  the  Breech  Block  Performance  Test) 
upon  various  combinations  of  predictor  variables  were  studi  i to  deter- 
mine whether  fleet  subjects  performed  better  on  the  leami  g task  than 
did  recruit  subjects  of  similar  ability  as  measured  by  Basic  Battery 
tests. 

It  might  be  added  parenthetically  that  none  of  the  subjects  reported 
any  previous  exposure  to  the  specific  task  of  assembling  or  disassembling 
the  breech  block  mechanism.  The  results  presented  in  Table  k are  far  from 
conclusive;  some  of  the  regression  lines  or  planes  had  significant  dif- 
ferences in  their  intercepts,  others  did  not.  In  should  be  mentioned 
that  the  purpose  for  using  multiple  predictors  is  tc  reduce  the  errors 
made  in  the  prediction  process;  however,  the  covariance  method  employed 
in  this  study  has  a characteristic  that  as  the  standard  error  of  estimate 
is  reduced  (by  increasing  the  number  of  predictor  variables),  the  occur- 
rence of  a significant  difference  becomes  more  likely.  This  is  possibly 
what  happened  with  the  values  reported  in  Table  k.  However,  it  is  again 
evident  that  fleet  subjects  had  a tendency  to  excel  the  average  recruit 
subject. 

The  findings  that  fleet  subjects  tended  to  do  better  on  the  learn- 
ing task  than  recruits  suggested  that  the  regressions 1 of  final  grades 
and  weekly  performance  grades  on  the  learning  scores  be  investigated. 

This  would  enable  ua  to  determine  whether  fleet  and  recruit  students  of 
similar  scores  on  the  learning  task,  which  to  some  extent  incorporated 
background  differences  between  the  two  groups,  earned  about  the  same 
grades  in  the  course.  As  we  saw  in  Table  2,  the  regressions  of  both 
final  grades  and  weekly  performance  grades  upon  the  learning  measures 
resulted  in  significant  differences  in  the  criterion  intercepts  (i.e., 
rejection  of  ).  About  70  per  cent  of  the  fleet  subjects  exceeded 
the  average  recruiw  subject  when  the  groups  were  controlled  on  the  basis 
of  learning  scores.  These  findings  indicate  that  there  was  a residual 
variance  still  to  he  accounted  for  when  past  experience  was  taken  into 
consideration  by  means  of  the  learning  measures.  However,  it  should  be 
pointed  out  that  the  unreliability  of  the  control  variable  (Breech  Block 
Performance  Test)  introduces  a bias  into  the  analysis,  and  any  interpreta- 
tion that  differences  in  experience  between  the  two  groups  could  not 
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account  for  all  of  the  residual  variance  should  take  this  biasing  factor 
into  consideration.  Further  research  would  he  necessary  to  determine 
how  much  of  the  residual  variance  between  the  two  groups  could  be  attri- 
buted to  experience. 

The  factors  hypothesized  to  account  for  better  performance  of  fleet 
personnel.  What  factors  then  might  have  accounted  for  the  better  perform- 
ance of  subjects  coming  from  the  fleet?  It  should  be  obvious  to  the 
reader  that,  although  the  study  did  establish  that  fleet  personnel  per- 
formed better  in  school  than  recruit  personnel  when  controlled  on  a 
number  of  factors,  it  was  beyond  the  scope  of  the  present  study  to 
identify  the  factors  leading  to  the  better  performance  of  fleet  personnel. 
The  following  hypotheses  were  developed  a posteriori  as  suggestions  for 
further  research: 

1.  tbtivation — the  desire  for  professional  advancement  in  the 
Navy,  an  expressed  interest  in  the  subject  matter,  greater  responsibility 
to  self  and  Navy,  and  recognition  of  the  importance  of  adequate  training 
may  have  led  to  greater  motivation  on  the  part  of  the  fleet  subjects. 

If  many  of  the  fleet  subjects  were  men  who  had  chosen  the  Navy  as  a 
career,  one  would  consequently  expect  stronger  motivation  than  for  re- 
cruits. Also,  there  may  have  existed  the  possibility  that  recruit  sub- 
jects were  taking  a rather  disinterested  view  of  any  training  in  the 
Navy  and  were  merely  "sweating  it  out." 

2.  Transfer  effects  from  fleet  experience--the  type  of  duty  that 
the  fleet  subjects  had  experienced  aboard  ship  may  have  facilitated  the 
acquisition  of  mechanical-motor  skills  by  means  of  transfer.  Some  indi- 
cation that  transfer  effects  were  operating  was  suggested  by  the  findings 
that  the  fleet  subjects  had  slightly  higher  scores  on  the  learning  task 
than  had  recruit  subjects  of  similar  ability.  However,  the  effects  of 
transfer  probably  did  not  account  for  all  of  the  difference  between  the 
two  groups,  as  is  suggested  by  the  finding  that  the  regressions  of 
final  grades  on  the  learning  measure  (which  tended  to  partial  cut  the 
transfer  effects)  were  significantly  different  for  the  two  groups. 

3 . Adjustment  to  Navy  life — the  greater  indoctrination  period 
for  the  fleet  subjects  may  have  resulted  in  greater  rapport  with  the 
instructors  and  staff  members  of  the  school,  and,  in  general,  may  have 
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meant  that  the  fleet  subjects  had  fewer  social  and  psychological  adjust- 
ments to  make.  Bie  recruit  subjects  may  have  had  a greater  number  of 
distracting  and  disturbing  elements  hindering  vkeir  learning  process. 

It  would  seem  extremely  desirable  to  under  take  research  to  isolate 
the  factors  associated  with  the  better  performance  of  the  fleet  subjects. 
Judging  from  the  results  obtained  by  Frederiksen  ana  Schrader  (2)  in 
which  they  found  a tendency  for  veterans  to  overachieve  in  college,  we 
might  expect  to  find  that  fleet  subjects  enrolled  In  most  all  types  of 
Navy  training  schools  will  perform  better  relative  to  ability  than  re- 
cruit subjects.  If  so,  the  crucial  factors  contributing  to  better  per- 
formance may  have  an  influence  upon  training  proced::^s  and  policies. 

Summary  and  Recommendations 

Students  selected  for  training  in  a Torpedoman’s  Jfates  School  are 
drawn  from  either  the  fleet  or  recruit  training  centers.  The  primary 
purpose  of  this  study  was  to  determine  what  influence  this  difference 
had  upon  the  relationships  between  test  scores  and  measures  of  success 
in  that  school.  The  findings  show  that  students  from  the  fleet  earned 
higher  grades  in  the  Torpedoman's  Mates  School  than  did  recruit  students 
when  scores  on  tests  from  the  Navy's  Basic  Battery  were  taken  into  ac- 
count. Thus,  this  difference  in  background  does  influence  the  relation- 
ships between  test  scores  and  performance  in  the  school,  and  to  such  a 
degree  that  separate  selection  procedures  for  the  two  groups  appear  ad- 
visable. The  results  of  the  study  suggest  that  there  are  factors  associ- 
ated with  fleet  duty  which  contribute  to  better  performance  in  the  school. 

In  an  attempt  to  eliminate  certain  factors  which  would  account  for 
the  difference  between  the  two  groups,  such  factors  as  age,  education, 
previous  mechanical-motor  experience,  and  transfer  effects  from  train- 
ing or  experience  gained  aboard  ship  were  investigated.  Bie  results 
indicated  the  fleet  subjects  were  older  and  more  heterogeneous  with 
respect  to  age  than  the  recruits,  but  that  age  did  not  appear  to  account 
for  the  differences  between  the  two  groups.  Education  turned  out  to  be 
a factor  operating  about  the  same  for  both  fleet  and  recruit  subjects. 
Previous  mechanical -motor  experience,  as  defined  by  an  experience  check 
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list,  failed  to  demonstrate  significant  correlations  with  practically 
all  predictor  and  criterion  variables  used  in  the  study.  Transfer 
effects  from  training  and  experience  gained  aboard  ship  were  shown  to 
be  operating  slightly  in  favor  of  the  fleet  subjects.  However,  these 
factors  did  not  seem  to  account  for  the  major  portion  of  the  differences 
between  the  fleet  subjects  and  the  recruit  subjects. 

It  was  not  possible  in  this  study  to  determine  the  relevant  varia- 
bles facilitating  the  better  performance  of  the  fleet  subjects.  However, 
three  factors  were  hypothesized  to  account  for  the  results  favoring  the 
fleet  subjects:  (l)  motivation,  (2)  transfer  effects  of  previous  train- 

ing and  experience,  and  (3)  adjustment  to  Navy  life. 

Further  studies  are  recommended  to  determine  (l)  whether  fD.ee  o 
subjects  perform  better  in  other  Navy  schools  than  do  recruit  subjects 
of  similar  ability,  and,  if  this  is  true,  (2)  what  factors  are  operating 
to  account  for  the  better  performance  of  fleet  subjects,  and  (5)  whether 
there  might  exist  an  optimal  exposure  to  Navy  life  which  would  tend  to 
maximize  the  benefits  fromTJavy  training.  Results  of  such  studies  would 
he  of  considerable  importance  to  the  Navy,  not  only  for  classification 
and  selection  procedures,  but  also  for  policies  and  procedures  pertain- 
ing to  the  training  of  manpower. 
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